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APPARATUS AND METHOJJS FOR MEDICAL DIAGNOSTIC AND FOR 



MEDICAL GUIDED DNTERVENTIONS AND THERAPY f 

CROSS REFERENCES TO RELATED APPLICATIONS 

This PCX Patent Application is related to and claims priority from commonly 
owned U.S. Provisional Patent Application No, 60/ 127,267 filed on Marcli 31. 1999 
entitled: 

' APPARATUS AND METHODS FOR MEDICAL DIAGNOSTIC AND FOR 
MEDICAL GUIDED INTERVENTIONS USING MULTIPLE IMAGING 
SYSTEMS, 

This Provisional Patent Application is incorporated by reference in its entirety 

herein- 

FIELD OF THE INVENllON 
The present invention relates to apparatus for performing medical diagnosis, 
and to apparatus for piazdng and performing medical intervcnnons or therapy 
procedures. Particularly^ the pr^ent invention is relaied to ^paratus for perfonmng 
guided medical in^rventions or medical dierapy procedures that employ mult^te 
medical imaging systenos for viewng the target in a body or body volume during the 
intervention. 

BACKGROUND OF THE INVENTION 

Duna$ recent years fusix^ images £rom different medical imaging systems In 
OTdcr to receive a better diagnosdc has become widely used. Additionally, the 
cooperative operation of several medical imaging devices can reduce the amount of 

1 
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radiation at which patient is subjected during diagnosis, therapy plannixig and medical 
procedures and interventions. While these facts have been already recognized, the 
realization of such cooperative operation has been until now generally restricted to 
medical imaging devices having a common mechanical platform. 

Additionally, various directional therapy procedures (based on directing an 
energy field towards a uo'get In a body) arc assisted by images of said body and target 
produced by medical imaging devices like CT, MR« ultrasound^ etc. 
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SUMMARY OF THE INVENTION 

4 

During diagnosis di)riag medical inter veniions or during thet^tpy procedures, it 

V 

may be necessary or Jielpfizi to operate several medical imaging devices simultaneously 
or sequentially. This is done upon necessity and compadbillty between the devices, in 
3 order to indicate tbe condition of the patient and/or designate a target in a body or 
body volume. For exanq>le tbe saixie largec can be viewed by ultrasoond and by some 
other medical imaging device sudi as a CT, X-Ray, or endoscope imaging device. 

The present invention con^rises methods and apparatus for combining two or 
more medical imaging systems (suda as an ultrasound and a CT) in medical diagnosis 

10 and procedures without medianical constrains between the position of tbe two or more 
medical Imaging devices. The present invention is panicularly usefol in guided medical 
interventions into a body or body volume^ where a target is sou^t to be evaluated. 
The apparatus disclosed in the present invention comprises at least two medical 
imaging devices for example, an ultrasound, CT, X-Ray, endoscope, at least a display, 

15 a data processor, and a position measurizig system comprising position contcoUing and 

V, 

position measuring co(aq>onenjts. At ieast part of the position measmriii^ cQwpomsjiXs 
are located at detmoined positions with respect to the medical frnagfng devices and 
calibrated with respect to the imageVbeam produced by the imaging devices. The 
position measuring system enables the establishment of the relative posidons between 
20 the at least two medical imaging devices. The data processor receivii^ the infonnaiion 
&om the position measuring system, is also able to ^tablish the poi^tion between the 
image planes/volumes produced by the at least two imagix^ devices and using it for at 
least one of the fbUowing; 
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a) maneuvering one or more imaging device^ ia order to scau the int^est 
target within the body accordizsg to infoimation available from another medical 
imaging device, or ^ 

b) facilitating image fusing wticn images of same plane/volume are available 
from two or more imaging devices. 

The cenn position me^uring components defines any of die following group: 
transmitter or recover or reflector or transceiver or optical indicia or inertial sensor or 
any combination of the above, suitable to be part of a position meastuing system. This 
position measuring systeatn may be magnetic, acoustic, optic, inertial or a combifiiation 
of the z±>ove. 

The resultant apparatus enables free-hand manipulation of all or part of the 
medical imaging devices used in the sasoe intervention or diagnosis. 

The apparatus and mediods described in the present invention facilitate the 
combination of a number of medical imaging devices to per&»rm various medical 
diagnostic, ther^y procedures and intervention tasks more safidy and efBcicaitly than 
those of the conveutionai systems. Particularly^ the apparatus of the present im^^idbn 
enabling viewing of a target with one medical tmagii:^ device and gnJdiQg a medical 
intervez^n tool or a medical ther£^eudc tool» or alternatively inserting a medi^ 
device when using a second medical imaging device^ This can be particularly usefbl 
when employing image guided medical inmrvntion systems such as those introduced 
by the assignees in commonly assigned U.S. Patent No. 5,647,373» entitled: 
Articulated Needle Guide For Ultrasound Imaging And Method Of Using Same, and 
patent ai^licati<ms, PCT/IL96/00050 (WO 97/03609), entitled: Free^Hand Aiming Of 
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A Needle Guide; PCT/IL98/0D578, entitled: System And Method For Guiding The 
Movements Of A Device To A Target Parricnlarly For Medical Applications; and 
PCT/IL98/00631, entjded: Calibration MeclKHi And Apparatus For Calibrating ^ 
Position S^isors On Scanning Transducers, all four of these docum^xts incoiporated 
5 by r^n^zce in their eoclreiy hcnsixi. 

The apparatus described in thi^ present invention may also reditce the anioiznt of 
radiation ^iplied on a patiefit dunxig diagitostic and medical interventions and/or 
therapy, for exanaple when u$ing ultrasousd and CT in the same intervention. 
The present invention also comprises methods and af^araros for guiding a directiona] 
10 therapy procedure witttoizt mechanical constrains between the position of the medical 
imaging device or devices used to assist the therapy procedure and the directional 
therapeutic device. The apparatus therefore, enables fre&-hand manipulation of part or 
all of the medical imaging devices used to a^ist the therapy procedure and/or of the 
ther^>eutie head. The term directional therapy procedure will define a^y procedure 
15 during which an energy field is directed cowards a target or area in the body of the 
patient. This ener^ field can be ultrasonic or Shockwaves (lithotrip^) . or 
electromagnetic (radiotherapy, laser^ etc) or particle beam (proton beam to sample). 
The data {accessor revives the information from the position measuring system and 
uses it for dixectis^ the fixerapy device head\beam Inwards a desired wg^ in the 
20 The method and apparatus are beneficial in that they have add-on caqsabiliti^; 

can define dynamic architectures, and enable free-hand maneuvering of all or part of 
die devices employed therein. 
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BRIEF DESqRIPTrON OF THE DRAWINGS ^ 
The picsem invention >vi iiow be described by way of the accompanying «^ 
drawing., wherein like nrfetence n«me«Js and/or characters indicaa. corxospooding or 
5 like coinponenis. In the drawings: 

FIG. la piooriaUy illustrates one form of a system constructed according in 
accordance widi tbe present invention for cooperative operation of an ultrasound and a 

> 

anrqsuierized topogts^phy (CT) apparanis; 

FIG. lb piciorially iUusttaies the relative positioa between the scanning beams 
of the CT and ultrasound in FIG. la; 

FIG. 2a is a vector diagram which piciorially illustrates the vectors used in 
calculating the relative position between the scamung bean« of the ulttasound and the 
CT in FIG la; 

KG. 2b is a block diagram iUustrating the steps involved in calciilating tte 
rtOatlve position between the scaiiaing brains of the ultraso^ 

HG. 3 piciorially iUusn^tes display ftiactions enabled according to tbe pfesent ? 
invention in relation to EIG. la;; -. • • 

FIG. 4 is a simplified flowchart illnstrating the swps of using in a cooperative 
niode two medical scanning devices in accordance to the present invaiti^ 

FIG. 5a pictorially ilh;st;ates one possible position measuring system to be used 
in «%ordance to the pxie$<ent invention; 

FIG. 5b pictorially illustrates another possible position measuring system to be 
used in accordance to die present invention; and 
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DETAIl£D I>ESCRIFnON OF THE EMBODIMENTS 

FIG. la aiustxates a first eazbodimem, exemplaiy of the preseat invcntioa. The 

V 

first embodiment utilizes at least two compatible medical imagii^ devices that produce 
medical images. Here, the medical Tmaging devices include an ultrasound apparatus 2, 
and a compmerized tomography (CT) apparatus 4, employed in a cooperative 
operation. AlteroaEely, the medical imaging devices could be the same or di^erem 
devices, or combinations thwwf, provided they operate cooperatively with respect to 
each other and are conQxatible. For exaii?)Ie, these devices may be devices that 
produce iniages by ultraso\Jiid, CQnq)Uisri2ed tomography (CT), X-ray» endoscopy etc. 

In the set-up illustrated ia Fig- I, for example^ images produced by CT 4 of a 
body 6 (or body volume) of a target 8 in the body 6 (body volume) may be utilized to 
position ultrasound traxisducer 18 at known position with respect widi respect to targ^ 
8, even if target 8 cannot be imaged as accurately by ultrasound. This is particularly' 
useful in CT assisted medical interventions enabling to use ultrasound images for 
real-time mDnimring of the invasive tool while using the CT images fcx primary 
location of the target. Additionaliy « inutges produced by die two medical imaging 
devices miay be combined in real-time or off-line to produce the detail required in the 
areaof the image required. This may also be used for monitoring anatomic changes 
due to breathing or intonnal movemems between the CT im^s and the situation of the 
body 6 at the time of the procedure. The system can be fitted to existing and d^Ioyed 
medical imaging devices wicbout m^yor modifications or adaptations. 

Ultrasound 2 and/or CT 4 ate connected to a display 10 via an image processor 
12 (optional) contained in data proctor I4» for displaying on display 10 at teast the 

B 
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images p«xfcccd by ultrasoimd 2 ^ CT 4. Uitt^ound 2 «nd/or CT 4 caa also be 

directly to display 10 via zhe necessary connecticns ^ I«rdware. I^e ^ 
processor 12 can be part of the data processor 14 or can be connected to it. 

Ultrasound 2 con^prfses a main unit 17 connected to a sc^ head IS ftefae, 
s to "tlu^ultr^und transducer as i^koown in tl« art. Cr 4 co^ 

unit (CT con^uter) 20 cozmecied to a scanning head 22, ftoher 
scamung J«ad. CT scanning head 22 includes Xlray cnUtter and dete«or(s) (not 

shown) as is known in the an. The ttnn scanning head will be used to define tte 
detccror and/or component of the xnedical imaging or scanning device, such as 

the transducer of an ultrasound, or the X-ray enritter and detector(s) of a CT or an 
X-ray or the CCD of an optical endoscope. 

A position measuring system compristag at least a position sensing controller 

26 and position measuring componen« (PMCS) 28. 30. 32 and 34 is used to measui*. 

the rdative position between ultrasound transducer 18 and Che CT scaamug h^ 

The term position measuring components Win define any of the followtog gronp: 

transmitterorreceiverorreflectororiranscelve^ 

m con^lnation of the above, suitable ,o be part of a niagnetic (for example, in 
accordance with the systems detailed in U.S. Nos. 4.314.251. 4.054,881) or 

acoustic (for exampte. to accordance with the system detailed in U.S. Patent No. 
4.124,838) or optic (for example, in accordance with the system detailed in U.S. 
Patent No. 4,649.504) or inerdal (fbr «can^ie. IS900 ma«ifectut«I by Wense 

Inc.) position measuring system or any combination of flK, above, all of the above 
iisted U.S. Patents incorporated by refe^nce herein. Ah«. position leve« in 



9 



WO0fl/S77fi7 PCT/IL00/0020a 

accordance witfi U.S. Patent No, 5, 647. 373 and PCTs PCTmse/ 00050, 
PCT/IL98/ 00578, PCT/IL98/ 00578 and PCT/IL98/ 00631, listed above, are also 
suitable. Position sensing controller 26 can be part of the dsxa. processor 14. 
In order to perform the task of measuring the leladve position between 
5 ultrasoimd transduce 18 and CT scanning head 22» position measuring con^onenx 28 
is atrached at a known and fixed position wxdi respect to the ultrasound transducer IS. 
The actaidhznent can be eidier directly to the transducer 18 or by means of an extension 
27. Position measuring cont^onent 28 is calibrated to ultrasound transducer 18 such 
that the ultrasound beam 36 is at a known and fixed position with respect to position 
Id measuring component 28* Such calibration can be achieved by operating according to 
PCX application PCT/IL98/00631 . 

Position measuring component 30 is attached at a known and fixed posidon 
from CT scanning head (gantry) 22. Hie attachment can be eidier directly to the CT 
scanning bead (gantry) 22 or by means of an extension 29. The tsm position defines 
15 location and/or orimtation. 

Position sensing contzoller 26 measures the relative position between position 
measuring conoponent 28 and position measuring component 30, enabling to calculate 
the relative position between ultrasound transducer 18 and CT scanning head 22. 
Position measuring component 30 is calibrated to scanning bead 22 such that the CT 
20 scsEmiing beam 34 is at a known and fixed position with respect to position measuring 
component 30. Such calibration can be achieved by operating accoxdhig to the 
co-assigned PCT application PCT/IL98/00631. 
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Relerence is now made to FIG. lb tbat shows, a detailed view of ultrasound 
transducer 18, CT scanning head 22 and position measuring components 2S and 30. 
Items referred to in previous figures are numbered simiiariy and will not be further 
described. 

Altemaifily/additioxtally position measuring component 32 may be attached to 
CT bed 15. The attachment can be eiiher direcdy to the CT bed 15 or by means of an 
extension 31. In this case position xneasuriz^ con^nent 34 is attached at a fixed 
position with req>ect to a reference position of the CT scanning head 22 (for example 
the default peipendicuiar posidon)^ and movements of the gantry 22 are con^ensated 
according to information available from the CT computer 20. 

An additional position measuring component 34 may be attached at a fixed 
position from CT scanning head attached from the cdUng of the CT room by arm 33. 
In this case position measuring component 34 is attached at a fixed position with 
respect to a reference position of the CT (for exan^Ie the defietuit position)^ and 
movements of the gantry 22 are compensated aocprding to inibnnation available from 
theCT20, ' 

It Is not nec^sary to use position measuring compon^its 30^ 32 34 together. 
Ra&er, it is sufGciem to use at least one of tfaeia. In order to operate the apparatus 
properly it is stiffidiem to inQslement only one of the above position measuring 
concqionents 30, 32 and 34 in combination with position measuring component 28. 
Position measuring components 32 and 34, if used, are calibrated to CT scannisog head 
22 similar to the calibiation of position measuring component 30, if used* 
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Since }K>sition measuring component 28 is calibrdted to transducer IS and at 
least otte of tbe position measuring componems 30t 32 and 34 is calibrated to CT 
scaimmg liead 22 it is possible to calculate tbe relative position between ultrasound 
scanning beam 36 and CT scaonis^ beam 38. This is cj>]rolated based on measuring 
s the relative position between position measuring coir^onents 28 and at least one of the 
following: one of position measuring componentsSO, 32 smd 34, and based on the 
calibration values defined above. The vector diagram of FIG. 2a and flowcbart of FIG, 
2b illustrate one possible algorithm to be used for calculating tbe relative position 
between the beams of the two medical hnnging devices. 

10 Reference to flowchan of HG. 2b, blocfe 40 shows the result of the calibrating 

position m^suiing component 28 to ultrasound transducer IS. Block 42 shows the 
result of the calibrating position measuring component 28 to ultrasound transducer 18. 
Blocks 40 aiul 42 are generally performed ofF-tine. Blodc 44 sboi^ the measurement . 
of the relative position of position sensor 28 with respect to position sensor 30. Block 

1^ 46 shows one possible set of equations (Equations 1 and 2 described below) for 

calculating the relative pK>sition between ultrasound scaiming beam 32 and CT scanning 
beam 34. Th^e equations are^ 

20 (Eq.2) 

The indexes and parameters in the above equations are according to vector 
diagram of FIG. 2a and flowchart of FIG. 2b. It is therefore possible to cakula^ the 
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relative position of transducer 18 and idtrasoimd beamUmase 36 with respect to a CT 
image or CT of Images, 

Necessary correctioii dtte to oiovixig the CT sttetdu^ 16 outside the gaxrtry canT 
be performed according to iufbrmation availai>le fiom the CT system (the displacement 
5 of stretdier 16 can be measured wiHi an accuracy of less than 1 

0.2Snim co 0,S nnn)« The movement of the bed stretcher 16 can be at a predetennined 
value bringing desired targec 6 or CT slice of interest at the same position from CT 
scanning head (gantry) 22. Alternately, the CT stretcher 16 can be moved at any 
desired position. 

10 Necessary correction due to tilt of the scanning head of the CT 22 may be 

performed according to information available Irom the CT system 4. 

Necessary correction due to swivel of bed stretcher 16 can be performed 
according to information available firom the CT system. 

Necessary correction due to using oblique or perpendicular CT images can be 
15 performed according to informatioa available £rom the CT ^stem. 

AU tbe above mentioned correcdon. values can be manually mpucced to tg^ data 
processor 14 or transferred through commmiicaTion links from CT main unit 20 or data 
processor 14 can identify them automatically, for example according to information 
generally available in the CT image (video or DICOM form). 
2D Similar or alternaEe algorithms can be ntq^tonented in connection co position 

measuring con^ionents 32 and 34. 

Re^nriziyg to FIG. 3 , the relative position of ultrasound image (scanning beam 
34) with respect to a set of CT images is indicated to the operator on the apparams 
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display 10. Hie uidicadlons are in 2*D a&d/or 3-D &s2uon for exazxiple in tke farm of 
boxes 60» 62, 64, 66.aiKl 68. 

The amount of deviation of ultrasound scanmng beam 36 from a ref^^sse CT 
> scanning image 38 can be displayed to the op&cisxor, for example in ihe from of angles 
5 and distances, as in box 60, and in ttie fbnn of 5ide*view illustration box 62^ and 
top-\^ew illustration^ box 64. Tim enables tbe ppexator to first scan body 6 by .CT» 
identic at least one target 8 in t>ody 6, and tben position ultrasound transducer 18 such 
as to view a desired CT sUceVimage. 

Additionally, target S can be marked in a CT image and it is possible to 
10 maneuver ultrasound transducer 18 sudi as to view the target 8. The indications can be 
in the form of box 66 comprising arrows indicating how to maneuver transducer 18 
and numbers indicating Hie distance of target 8 ftom ultrasound scanning beam 36. It is 
then possible, ibr exan^le, to guide an invasive tool towards target 8 based on CT 
images in combination with reai-tixne in^agiTig of the invasive tool by ultrasound. « 
15 Boxes 68 and 70 provide information regarding the position transducer beam 36 

wi^ respect to a volume of CT images. Box 68 shows die CT slice (i^consaructton) 

r 

aligned with the current position of transducer 18. Box 70 iilustxates the relative 
position of transducer 18 with respect to the scanned volume in a sagital view. 

While Fig. 3 illustrated specific display modalities for ^ttMin^ the user to 
20 cooperatively use ultrasound 2 and CT 4 information additional or alternate displays 
may be used. 
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In applications requiring very hi^ accuracy it my be necessary to constram 

4 

body 6 in order to avoid small mov^nents between scamiing body 6 by ulTrasoimd 2 
ax3id scatuiing body 6 by CT 4, la most applicadoxts this requirement is not necessary. 
Reference is now made to FIG. 4 which is a fiow-cbmx illustration of the stq?s 
5 required in order to operate ultrasound 2 and CT 4 in operative cooperation as 
illustrated in Fig. I and in accordance to the present invention. At step 90, it is. 
measured the relative position b^:weffl position measuring components (PMC) 28 and 
30 (FIO. 4). It is possible to use position measuring conq^onents 32 or 34 or both 
instead or in addition to posidon measuring coni^nent 30 (as explained atove). At 
10 step 92 It is calculated the relative position between ultrasound scanning 

plane/voiume/image 36 and CT scatudng plane/volume/image 38. The calculation at 
step 92 is based on the caiibniition of position measuring component 28 and 30 (32, 34) 
with respect to ultrasound transdiicer IS and CT scanner 22 (step 94). The calculation . 
in step 94 may also be used in other medical procedures (step 96) that is optional, but 
IS preferred, for example in image guided interventions, such as described in commonly 
assigned U.S, Patent No, 5,647,373- Hie caloilation in Step 92 may also be us«i in 
order to instruct the maneuvering ultrasound transducer 18 in a required position. 
Once the relative position between the scanning phmes/volume is calculatfid toe images 
from CT sysmm 4 and ultrasound system 2 may be correlated and or fhsed in optional, 
20 but highly prefsrred step 98. This can be porftitmed according to conventional image 
ptocessing a^odtfams and tecOmiques, By ootrelating or fusing tiiese images (from d^ 
uhxasound axul CT scanning beams, respectively), the displayed ultrasound image may 
be enhanced. The superm^iosed image/information resuldng of 98 may be 
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optionally used to improve calcuIatioiL at step 92 in an iterative mode. The 
superimposed image/ixxfonnation resulting of $tep 98 may also be used in otber medical 
procedures (seep 96) or in order to instnicc matieu v^ixig of ultrasound transducer 18 
(step 120). 

The imagiEzg opdons ICQ are non-exbaustively, listed as follows* The image 
from CT system 4 and ultrasound system 2 may be displayed individually (steps 102 
and 104)^ the relative position between CT and ultrasound scanning beams may be 
di^layed (st^ 106, illustrated in Fig. 3) and the result of image fusing^ at step 98 may 
also be displayed (si^ 108), Target and image correlation inibimation can also be 
available to the operator indicating for example internal anatomic movements as 
explained herein below. 

In addition to and interacting with display functions 100, there are various 
ancillary Itonctions such as optionally marking a target 8 (step 1 12) on the image 
produced by one of the imaging devices as appearing on display 10> Then the position 
of tari^et 8 may be calculated within the scanning beam of the medical imaging device, 
(step 114). Additionally/altema^ly a reference plane/volume may be marlced of 
signaled according to the image proAiccd by one of the imaging device (step 116). The 
pasition of the reference plane/vohune may dien be calculated (step 118). Hie data in 
steps 114 and/or 118 may be optionally used in order to xx^truct the positioning of CT 
scanning iiead 22 and ultrasttmd transducer 18 with respect to each other (step 120). 

A specific implementation to be used in connection to the present invention 
regards the use of image cozreladon in e^iicatif»i$ where internal organs may 
significantly move between the titne the CT scan was perfbrmed and the time of 
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perfonsuxig a procedure. Body volume 6 is scazmed by the CT system 4 producing iugh 
resolution image/infbnnation. Tbe opeiator defznes at least one target on CT image as ^ 
displayed on display 10, The same target is then scanned with ultrasoond transducer 
IS. The position of the ultrasouDd scanning beamVimage 36 is d^ermined (as detailed 
5 above) with respect to position of the CT scanning beam 38. AddiuonaUy, by 

comparing the relative position of target 8 in the ultrasound image with the position 
caicoiaied ficom the CT image, it is possible to monitor and contpensaEe for internal 
mov«aient$ or for respiratory changes in body 8 between takiQg the CT scan and the 
time of performing an intervention* For this implfflientadon it is preferred (but not 
10 necessary) to mark mtore than one target/points In the CT image and then locate tfiem 
by ultrasound. This enables to calculate internal anatomic displacements inside body S, 
between the images produced by the CT and the situation during the time of an 
intervention. The operation defined above can also be performed automatically 
provided enougjh distinctive targets\points\clusters may be found in the CT and 
15 ultrasound images , 

Reference is now made to HG. 5a that illustrates a magnetic position ' ^ 
measuring system io be used in accordance with an cxen^Iary ecibodiment of the 
present invention* Similar tons in previous figures have similar numbers and will not 
be fonher described, 

^ In this exeoqilary ^bodicnent posidon measuring componetit 28 is a meiver 

28* bei^g attac:hed to ultrasound transduce 18 and position measuring coxrqpon^t 30 is 
a transmitter 30' being attached to CT scanufng head 22 by an arm SO*. Transmitt^ 
30' is transmitting AC or DC magnetic/electromagnetic signals to receiver 28' . The 
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ouiput of receiver 28' is transmitted by wire or wireless coxmeciions ro positiozi 
sesising comroUer 26 mablixig to calculate die relative position of receiver 28' witb 
respect to transmitter 30\ Alternate^, position measuring conqoonenC 28 could be a ^ 
transmitter and position measuring component 30 cQUld be a receiver. 

5 Reference is now made to HG. Sb wber^ an optical position measuring 

system is employed in accordance with another ex^x^iaty embodimrat of tlie present 
invention. Similar iccms in previous figures bave similar numbers and will not be 
farther described. A stereo vision dtiarg^ coupled device (CCD) camera 84* is 
positioned on an aim 86' at a first refer^ice location. Position measuring conqponent 

10 28 includes a cluster of LED's 28'* being ateacbed to ultiasouxid transducer 18 by an 
arm 88' and position measuring conQ>oncnt 30 includes a cluster of LED's 30*' being 
attached to CT scanning head 22 by an ann 80" . The relative position of cluster of 
L£D*s 28'* is measured with respect to tbe CCD camera 84' (first reference location), 
and also ttie relative position of clusta* of LED^s 30' ' is measured with respect to CCD 

15 camera 84' (first reference location). It is therefore possible to calculate frofm the 
above measurements the relative position of cluster of LED's 30" witilL req>ea 
duster of LED's 28" and hence, the relative position i>etween ultrasound scanning 
beam 32 and CT snanning beam 34. 

The above detailed position measuring syst^ns enable measurement of the 

20 r^ative position becween ultrasound transducer scanning beam 32 and CT scanning 
beam 34 can be optical, acoustic, magnetic or inertial or a combination of the above. 
The relative position becween position measuring con^nents 28 and 30 can be 
measured directly, for example^ when one of the conq>anents is a recdver and the 
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other one is a transmitter as illuseraxed in the exemplary embodimeiit in FIG. 5a. 
Alternately, the relative posUioa betweai position measnring components 28 and 30 
can be calculated ixulirectly , for exan^^Ie, by measuring the poskion of each with 
respect to a refisrence location bs iltastrated in the exen4)laiy embodiment in HG. 5b. 
5 When making these indirect calculsitioiis, a third position measuring component 

84 (illustrated in FIG. 5b by a stereo Charge Coupled Device (CCD) 84') is in. 
operative communication with position mea$orii^ components 28 and 30, this CCD 84 
is positioned at a first reference location. The first reference location may be fixed and 
known. Alternately^ the first re£srenoe position can be movable azid tmknown. 
10 Optionally, the first refeiezu^e poskion can be attached to the bed 24. 

Position measuring componeots 28, 30 and 84 (if part of the system) may be 
any of the following group; transmitter or receiver or reflector or transceiver or optical 
indicia or any combimtion of the above. Position measuring components 28, 30 and 84 
(xf part of the s3^tBm) may be part of a magnetic or acoustic or optip or infrtir^l 
15 position measuring system or a combination of the above. 

Position sensing controller 26 may communicate with at least one or all of 
position measuring components 28, 30 and 84 (if part of die system) by wired or 
wireless links. 

Reference is now made to FIG. 6, which illustrates an additional embodiment 
20 of the present invention. Similar items to diose shown in previous figures have similar 
immbers and will not further be described. The second embodin^nt illustrates an 
ultrasound 2, and an X-Ray 138 to be used in cooperative cq>eration according to the 
present invenpon. The X-Ray imaging device comprises X-Ray main unit 140 and 
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X-rRay scanning head 142 including amtter 142' and deteccpr 142'* X-Ray scanning 
head 142 is moimted on a movable and adjustable aim 144. Bed^24 may or may not be 
part of X-Ray imaging device 138, ^ 

Position measuring compozient 30 is attached at IciU)wa 

•5 X-Ray scanning head 142. Additionally^ position measuring component 30 Is calibra^ 
to liie scanning head 142 su^ that it is at a known position £rom the scanning volume 
of the X-Ray . Such calibrations can be achieved by operating according to patent 
application PCT/IL98/00631. The relative position between ultrasound transducer 
scanning beam 36 and the X-ray scanning volume 146 can be calculated as described 

10 in the first embodiment based on direct measurement between positi<m measuring 
components 2S and 30. 

An additional position measuring con^nent 84 can be placed at a reference 
location on an arm 86. This position taeasunng comiN>n»t 84 (if used) is in 
cocq?eraiive communication with positiOT measuring components 28 ami 30. Thus^ the 

15 position of ultrasound transducer 18 and of the X-Ray scanning head 142 are measured 
with respect to the reference posizioa similar to the calculation described in rela^on to 
FIG< 5b* Body 6 can be fixed so as to avoid movement during the procedure. X-Ray 
scanning head 142 is positioned in order view target 8 in 0ie body 6 or body volume 
at two difEet^ positions. The position of X-Ray scannmg head 142 is measured with 
20 respect to reference position thus enabling to correlate the two images into stereo 
information in order to receive a 3D image of the scaxmed body 6. Algorithms for 
creating such 3D image/informatioii from stereo 2D images/information are known to 
those skilled in the art. 
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In one exemplary use of present inveniion, ifae operator may Indicate tai^et 8 

r 

on Che image received from the X-Ray 138 for example, by marlcing it with a mouse 
on the dispfoy 10 (as described herein above with re&rence to Figs. .1-3).. The relative 
position of target S can be calculated with respect to the ref^ence point, tntrasoand 
transducer 18 is then applied to bocfy volume 6 and its position is measured wilh. 
respect to the reference position. Thus« ii is possible to calculate the position of 
ultrasound scanning plane 36 with respect to the image volume received from X-Ray 
138 and target 8. 

Alternately* the body volume 6 is first imaged by ultrasouud in order to 
establish a desired referoace plane/volume that includes a target 8.. The op^ator selects 
a reference plane, in accordance with the procedures detailed above. Alternately, the 
operator indicates target 8 for example by marking it on the display 10, using 
conventional marking software, as described above. Data processor 14 stores the 
position of target 8 or of reference plane with respect to the reference location. 
Ultrasound transducer 18 is then removed and the position of X-Ray scamung head 
142 is calculated with respect to reference plane or target 8. Hius, it is then po^ible to 
position X-Ray scanning head 142 in an optimal way at two different positions so as 
two view target 8 and afterwards produce a 3D image/hifomiation. 

Additional modalities of employing in operative cooperaddn ultrasound 2 and 
X-Ray 138 are similar to those described for tlie system illustrated in Figs. la^4 and 
described above. 

Reference is now m ad e to FIG. 7a and 7b» wbids illustrate an additional 
embodiment of Ihe present invention. Similar itmis to those stown in previous figures 
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have sijmlar niinrt)«:s aiid will not furth^^ be d^cribed. The second onbodiment 
iUustraws an uUrasound 2, and an optical endoscope 150 to be used ia cooperative 
operarion^according to the present invention. Said endoscope 150 conqjrxsing an 
endoscqpe head 152 with a CCD 154 (not shown m die drawing) and optical appaiams 
156 (not shown in the drawmg). Endoscope head 152 can be rigid» ot can be flexible. 
It is still possible to use a r^id endoscope head 152 with a mobile tip enabling to 
change the angle of view. It is also possfljle to use endoscope with changing field of 
view. 

Position measuring component 30 is attached at a known position with respect 
to optical cndc^cope head 150 and calibrated to the endoscope image 158. Position 
measuring component 28 is anacbed at a known position with rdspcct to transducer 18 
and calibrated to transduce beam/image 36 as described above. If eindoscope head 152 
is rigid position measuring component may be attached hitemally or eximxaliy at any., 
fixed position with respect to endoscope head 152. If endoscope head 152 is flexible or 
has a mobile dp, position measuring con^nent 30 is positioned at die tip of head 150. 
An exas^ie of such position measuring cot^ponent is tlse magnetic ^naor ^ 
manuf actured by Mednetix Inc. Altemady, position ccmiponent 30 can be a 
combination of two difiPerem ftinciional sub-conqionents. A first sub-component of 
positions measuring con^nent 30 measuring the position of Ifae head 152 ac a de&uit 
situation (defimit bcmding or defatult tip position). A second sub-component of position 
measuring coii?K>nent 30 being attached to the flexible pan of endoscope head 152 
(and preferably also to the tip) and providing faidication with T^^ct jo the bending or 
movement of die flexible part with respect to said default situation. An illusaative 
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example for such a second sub-congTonent could be a fiber optic sensor manufactured 
by Measttrand ^c. Still alteruacely, iu the case of a rigid endoscope wit tmbxle tip it 
can be possible to receive from the endoscope inftirmation regardfng the deviation 
from the defeult.situatioa. 

According to one aspect of the present invention target 8 is viewed by 
ultrasound trattsducer 18, and endoscope head 152 is maneuvered to view target S 
based OR guiding infermation received from data processor 14 (not shown in Fig. 7) 
and displayed on display 10 (not shown in Fig. 7). The guidance can be in accordance 
to the methods introduced by the assignees in above cited patent {plications 
PCT/IL96/00050 or PCT/IL98/00578. 

According to another aspect of the present invention target 8 is viewed by 
transducer 18 and also by endoscope head 152. It is then possible to mack target 8 in 
the ultrasound image and calculate its position with respect to position measuring 
component 28. According to the measured relative position between position 
measuring componenls 30 and 28 and based on the calibration of position measuring 
component 30 to the endcscope image 158 it is possible to cateuiaie the 3D posifion of 
target 8 with respect to endoscope image 158, This enables to guide an invasive tool 
towards target 8 based on endoscope image 158 from any desired according to 
the method and appmitus described in above cited pat^ applications PCTyiL96/00050 
or PCT/IL98/0057S. 

According to another aspect of the present invention it is possible to receive 
depth information from the endoscope image by alternative methods without the need 
to use transducer 18. According to one alternative method a target is viewed by 
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endoscope 150 while moving die endoscope head 150 at several positioiis on a sctaic 
line arouod the focussed posidon, at lease one position providing a fbcussed image cf 
the targets According to die focussing and de-focussing of the taxget and according to 
the measured position of position measuring component 30 it is possible to receive the 
5 depth of the target in the endoscope image from algorithms known as * 'depdi horn 
focus' According to another method endoscope head 152 is viewing a volume of 
body 6 comprising target 8 from at least two diSerent positions enabling to implement 

T 

3D stereo imaging* The implememaiiDn of the stereo imaging algorithm is based on 
knowing the relative position between the two or more positions of the endoscope head 
10 152^ According to still anodier method it is possible to receive the depth of a target 8 
from methods known to those skilled in the art as ' *d^th from shading* ' Such 
methods are described in US Patent No. 4,714,319 and US Patent No. 4,695,130 
All the above described methods can provide 3D information regarding ^e 
position of target 8 in the image produced by endoscope 150* It is therefore possible to 
15 aoach an additional position measuring component to an invasive tool ^nij guide it to 
target 8 assisted by endoscope imaging in accordance to the mediods described "in 
guidance n:iethod& according to above cited patent applicadons PCT/IL^/OOOSO or 
PCT/IL98/00S78. 

While the invration has been desaribed with respect to several preferred 
20 embodiments, it will be appreciated that these are set forth merely for purposes of 

example^ and diat many variations, modifications and s^plications of the mvennon may 
be made. Accordingly, the scope of die invention is defined by the claims^ which 
follow. 
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CLAIMS * 

1. A method enabling free of predefined mechanical constraiuts cooperaiive 
operatiion of two or more medical iTnaging devices useful in medical diagnosis and/or 
medical therapy planning and/or medical interv»don planning and/or medical therapy 
and/or medical incecvendon and/or medical procedm-es, the method comprlsixig the 
steps of: 

imaging a body volume/plane with a first medical imaging device; 

sensing the position of a second mecUcal imaging device with respect to 
said first medical imaging device by means of a position measuring system 
comprising position measuring controller and position measuring components; 

scanning part or all of said body volume/plane with said second medical 
imaging device; 

calculating the relative position of said second medical imaging device 
and/or relative position of the scaxzning plane/volume produced by said second 
medical imaging device with respect to said first medical imaging devic6*az}d/or 
with respect to the scanning piane/volimie produced by said first medical 
imaging device; 

displaying on at least one display screen said calculation in a cooperative 
way to the medical operator. 

2. The meifood according to claim I where said first and said second mgrficaT 
imaging devices operate sequentially, 
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3. The method according to ciahn 1 where said first and said second medical 
imaging devices operate sknultaneously and/or iatennittently. 

4. The meau>d of claim I where said one first and said one second rr}€i^\r^] irpn ^nff 
device are one of die group X-Ray » CT, MRI or idtrasoimd, endoscope. 

5. The mediod of <daim 1 where die position measuring system is from the group: 
magneric, optic, acoustic, inertial« fiber optic or a combination of the above. 

6\ The method of claim 1 where the st&p of sensing the position of second medical 
imaging device with respect to said first medical imaging device is performed by 
means of wired or wireless communication. 

7. The method according to claim 1 where the position of the scaiming 
plane/ volume/image produced by said second medical imaging device is calculated 
with respect to the scannii:^ plane/volume/tmage produced by said first medical 
imaging device. 

8. The method according to claim 1 where the scanned plaj^e/vclume produced by 
said first medical imaging device is correlated and/or fused by image processing tools 
mth the scanned plane/volume/image produced by said second medical imaging 
device. 

9. The method acQording to claim I fhrther camprisiog the stqp of iiuiicating to said 
position sensing system the position of a target by marltiug said target on said at least 
one display scre^ or by automatic recognition of the target in the image* 
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' - 10. Tlie xnechod according to dialEn 1 fuidier comprismg the step of i ndica t i ng to 

* 

said position sensing system the position of a refbrenoe plajae/vcdume by marldng said 

V 

reference plane/yolume on said at least one display screen* ... 

11. The me^od accotding to any of the claims 9 or 10 » wliete the position of tbe 
said, second medical imaging device is calculated with respect to said target and/or said 
reference plane/volume/image, 

12- The method according to claim 1 where the position of the scanning 
plane/yolnme produced by said one second medical imaging device is caloilated with 
respect to s^d target and/or said reference plazie/volume. 

13. The method according to claim 1 and finther comprising the step of indicating 
on said at least one display screen the actual progressive motion of said second medical 
imagiTig device towards said target and/or reference plane/volume. 

14. The method according to claim 1 and fhrther conq^ing the step of indicating 
on sffld at least one display screen the deviation of said second m edical imaging device 
or scanning plane/volume produced by said second medical iTnagiTig device fromfsald 
ta^rget and/or from said referoow plane/volGDne« * 

15. The method according to dlsam 1 and finrdier conq^rising the step of adjusting 
die position of said second iTmging device so as to cause it to inidude in its scan 
plane/volnme/image said target or to cause that its scan plane/volume coincide with 
said reference plane/volume. 

16. The method according to claim 1 and totber comprising the step of correlating 
the calculated position of at least on target or ^ relative position between several 
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targets/points in order to assess interna] acatomic movements between differ^t stages 
of a medical procedure. 

17. Apparatus enablmg free of predefined mechanical constraints cooperative 
operation of two or more medical imasing devices usetul in medical diagnosis andVor 
medical tberapy plaxming and/or medical intervcnnon planning and/or medical therapy 
and/or mimical intervention and/or medical procedures » apparams comprising:' 

one first medical imaging <tevic€^ 
one second medical imaging device; 

a position measuring system comprising at least the following: a position 
sensing controller and at least one first position measuring component at a 
known position with respect to said first medical imaging device and second 
position measuring component at a known position with respect to said second 
medical imaging device; 

a data processor for receiving data from the position sensing controller for 
calculating the relative position of said second medical imag^ttg device and/or 

relative position of the scanning plane/volume produced by said second^nedical . 

it 

imaging device with respect to said jSrst medical ima^ng device and/or with 
respect to tihe scazining plane/volume produced by said &5t medical imaging 
device, swi data processor displaying on at least one display screen said 
calculation in a cooperative way to the medical operator. 

18. Apparams according to claim 17 where the at least one display screen is one. 

19. Apparatus according to claim 17 where said firsi and said second medical 
imaging device operam simultaneously and/or intermittently. 
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20. Apparatus of claim 17 where said first and said second medical imaging devi«s 

« 

are one of flie group X-Ray, CT, MRI, ultrasound or eodoscc^. 

21. The apparatus of claim 17 where tlie position measuring system is ficom die 
group: magnetic, optic, acouspc, ineriial, fibear optic or a combinatioa of the alwve, 

5 22, Apparatus of claim 17 where the step of sensing the position of said seooiKi 
medical itnaging device with respect to said first medical imaging device is performed 
by pftflTis of wired or wireless oomnntmcatioa* 

23. Ajqaarams according to claim 17 wtisro said at least one first position 
measuring component is attached onto said first medical imitging device. 

ID 24- Apparatus according to claim 17 where said at least one second position 
measurir^ conaponent is attached onto said second medical i m a gi ng device. 

25, A^qparatus according to claim 17 where said at least one first position 
measuring component and said at least one second position measuring compoi^nt work 
in operative communteation. 
15 26, Apparatus according to claim 17 where said calculation is ba^ on the direct 
mcasareznsmt of the relative position becwew said at least one first position measurii^ 
component and s^d at least one second x^ition measuring component. 

27. Apparams according to claim 17 where said calculation is based on directly 
measuring the position of said at least one first position measuring component with to 
20 said at least one second position measuring coit^onent. 
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28. Apparatus according to claim 17 where said positiozi measurbog system ^ 

additionally con^rises at least one tliizd reference position measuriz^ coxnponent fa^ng 

V 

placed ai a first reference location; 

said at least one third position measuring component being in operative 
communication with said at least one first position measuring component and 
said at least one second position measuring component and enabling to 
calculate the relative position between them. 

29> Apparatus according to claim 37 where the scanned plane/volume produced by 
said at least one first medical imaging device is correlated and/or fused by image 
processing tools with the scanned plane/volume produced by said at least one second 
medical imaging device. 

30. Apparatus according to cUum 17 and ftirther comprising' tlie step of correlating 
tbe calculated position of at least on target or the relative position between several 
targets/points in order to assess internal anatomic movements between di£Eerent stages 
of a medical procedure. 

31. Apparatus according to claim 17 fiirtfaer conqirising the step of indicating* to 
said position seising system doe position of a target by marking said target on said at 
least oooe display screen or by automatic recognition from the Image.. 

32. Apparatus according to claim 17 fUttber conq>rising the step of indicating to 
said position sensing syston the position of said refereiK:e plane/volume by marking 
said reference plane/volmne on said at least one display screen. 
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33. Apparatus according to any of &e claims 31-32, where the position of the said 
at least one second medical imaging device is calculated with respect co said target 
and/or said reference plane/volume. 

34. Apparattts according to claim 17 \^iere ih& position of the scanning 

5 plane/volume produced by the said at least one second medical imaging device is 
calculated with r^pect to said target and/or said reference plane/volume. 

3^. Apparatus according to claim 17 axid further comprising the step of indicating 
on said at lease one display screen the actual progressive motion of said at least one 
second mescal imaging device towards said target and/or reference plane/volume, 

10 36. Apparatus according to claim 17 and further ccaaapnsSns the step of indicating 
on said at least one display screen the deviadon of said at least one second medical 
imaging device or scanning plane/volume produced by said at least one second medical 
imaging device from said target and/or from said reference plane/volmne. 

37. Appamtos according to claim 17 and :&irdier comprising the step of cortelattiig 
15 the calculated position of at least on target or ihe relative position between sevej^ 

targets/points in order to assess internal anatomic nu>vements between different stages 
of a medical procedure. 

38. Apparatus enabling to guide an invasive tool towards a target visible by 
endoscope means, in a free of |»ed^ned mechanical constraiius cooperative operation 

20 comprisixig: 

an endoscopic imagii^ device; 
an invasive tool; 
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a positiozi measurii^ system comprising at least the foUo^^g; a positic^ 
sensing controjier and at least one first position measuring: component at a 
known position mth respect to said endoscope imaging device and second 
position measuring component at a Icnoivn position with respect to said invasive 
tool; 

a data processor for receiving data tcom the position sensing controller for 
calculating the relative position of said invasive tool with respect to the 
image(s) produced by said first medical imaging device, said data processor 
displa3ring on at least one display screen said calculation in a cooperative way 
to the medical operator. 
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